In my line of work, I regularly criticize black, white, hispanic, gay, straight, muslim, christian, jewish and many other combinations of ethnicity/gender/religion/etc..
I have never once been called "racist" -- even by those I've criticized -- and no one has ever accused me of using racist speech.
So I don't think the problem is criticism here. . .